Halos and Horns in the Assessment of Undergraduate Medical Students: a Consistency-based Approach
نویسندگان
چکیده
The authors introduce a consistency-based approach to detecting examiner bias. On comparing intra-class correlation coefficients on transformed data for supervisor continuous performance and report marks (ICC1*) with those for supervisor continuous performance and second marker report marks (ICC2*), a highly significant difference was obtained for both the entire cohort (ICC1* = .72, ICC2* = .30, F = 2.47, p < .0005 (N = 1085)) and the subgroup with high supervisor ratings for continuous performance (ICC1* = .62, ICC2* = .24, F = 1.97, p < .0005 (n = 952)). A strong halo effect was detected and preliminary evidence was obtained for the presence of a strong horn effect for students with lower scores, thus providing a basis for future research.
منابع مشابه
Comparison of differences in performance evaluation of faculty by students with faculty’s self-assessment
Introduction:The present study aimed to compare self-assessment forms of coursework taught in the school of public health at undergraduate, graduate, and postgraduate levels and students’ evaluation of the performance of the faculty members at these levels.Methods: The subjects in this cross-sectional study were the faculty members and students of the School of Public Health and Nutrition, Shir...
متن کاملInfluence of Assessment Method Selection in Studying and Learning Approaches: Is It Necessary to Change Assessment Style?
Background: It is important to learn how to study for different examinations. The objective of the current study is to explore whether the assessment method selection would significantly affect the studying and learning approaches of students. Methods: This descriptive-analytical research consisted of 191 first-year undergraduate nursing students from three nursing schools and was conducted dur...
متن کاملTeam-based assessment of professional behavior in medical students
Introducrion: Self and peer assessment provides important information about the individual’s performance and behavior in all aspects of their professional environment work. The aim of this study is to evaluate the professional behavior and performance in medical students in the form of team based assessment.Methods: In a cross-sectional study, 100 medical students in the 7th yearof education we...
متن کاملResearch Trend, Career Preferences and its Effective Factors among Undergraduate Medical Students in Jinnah Sind Medical University, Pakistan
Background: Research at undergraduate and graduate level is important in deciding career fields and future profession. The undergraduate studies are greatly enriched by doing research work. This study assess research trends among medical students by evaluating their research career choices, factors influencing their research career preferences and future plans at Jinnah Sind Medical University ...
متن کاملAssessment of learning style based on VARK model among the students of Qom University of Medical Sciences
Introduction: Learning is a dominant phenomenon in human life. Learners are different from each other in terms of attitudes and cognitive styles which effect on the learning of people. In this connection, VARK learning style assess the students base their individual abilities and method for obtaining much information from environment in dimensions of visual, aural, read/write, and kinesthetic. ...
متن کامل